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Method to evaluate whether a time delay is better than a 

time limit 



The invention concerns a method to evaluate whether a time 
delay as an implementation dependent parameter is better 
than a statistically defined soft time limit. The 
invention is especially applied to a class of measurements 
measuring the delay time from a cell quality swap, 
generated by a system simulator, to the registration 
message, generated by the user equipment, a mobile station 
for example. In a mobile communication system the mobile 
station (user equipment) should make a cell reselection 
or handover to another base station of another 
communication cell if the quality of communication with 
the current base station of the current cell (cell 
quality) decreases and the communication quality with an 
other base station of an other cell increases over the 
quality of the current base station. 

Such a soft handover handled by a mobile station in a 
communication system with several base stations for a 
mobile system of the third generation using Code Division 
Multiple Access (CDMA) is known from US 5,267,261 for 
example. 

The communication standard defines a maximum delay time 
from the swap cell quality until the time where the user 
equipment issues a registration message in order to 
register to the other base station. However, this time 
delay TD is not defined as a hard limit, i. e. the user 
equipment would not fail the test if the delay time 
exceeds the time limit only a single time, but is defined 
as a soft time limit, i. e. the user equipment shall 
fulfil the test requirement for a certain percentage (for 
example 90%) of the cases in repeated measurements. The 
pass fail decision of the test -equipment shall be done 
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with a certain quality, for example 3% wrong decision 
risk I 

From the present state of the art it is not known how to 
5 deal with such statistically defined soft time limits for 
repeated tests. 

Such a test is time consuming. This is illustrated by the 
following example: The success ratio SR in this example is 
10 90%. The time limit in this example is 8s. Due to 
statistical significance it is not enough to observe 9 
successes in 10 measurements. For statistical significance 
it is usual to observe 200*9 successes in 200*10 
measurements - This test lasts 4 . 5 hours . 

15 

It is the object of the present invention to provide an 
effective method to make a pass fail decision , especially 
on repeated time delay measurements, against a 
statistically defined soft time limit. 

20 

It is further the object of the present invention to 
provide an effective method to make the pass fail decision 
in the minimum possible test time preserving the 
statistical significance . 

25 

The object is solved alternatively by the features of 
claim 1, 2, 7 or 8 . 

The depended claims concern further developments of the 
30 invention. Claims 20 to 23 cover the respective digital 
storage mediums computer program and computer program 
product . 

The invention is further described with respect to the 
35 drawings. In the drawings 

Fig. 1 shows the scenario of cell swap and measurement 
of delay time; 



.1^ 
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Pig. 2 shows a block diagram of the measurement set up; 

Fig. 3 shows a diagram to illustrate the inventive 
method. 

Pig. 4 shows the referenced Error Ratio er^^ as a 
function of the measured errors ne. 

Pig. 5 Shows a diagram to illustrate a measurement 
usxng a first embodiment of the inventive 
method. 



Pig.. 6 shows a diagram to illuatraj-« = 

u ij-iuscrate a measurement 

15 ""^""^^ ^ embodiment of the inventive 
method and 



Fig, 



shows a diagram illustrating the position at the 
end Of the test using the first embodiment of 
20 \ inventive method as a function of 

probability. 

t.me delay. P.g. . ^howa the respective measurement set 



25 



30 



35 



A system simulator ss simulates the two cells cell i and 
cell 2 of a cellular mobile communication system. A User 
Equipment UE (mobile station, is registered to one of the 
cells of the cellular mobile communication system The 
system Simulator swaps the cell ^ality at speclWc 
cycl.c time points Tl and T= . Prom time TX until L 
cell 1 has the better cell, <^ality compared to cell 2 \Z 
exa,nple the field strength received by the User Equlpmint 
OE from cell l is 3dB higher than received from teiT2 
From T2 to Tl the cell ^ality of coll 2 is better a" the 
cell ^llty Of cell i. The User B^ipmant ^ 
recogn.se the cell swap cs and should react to the^^u 
swap cs by issuing a registration message im. With the 
regxstration message R« the User Equipment UE registers to 
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the cell serving with better cell quality. The User 
Equipment UE needs a specific time delay TD to evaluate 
and recognise the cell swap. CS and to react thereon with 
the registration message * RM. This time delay TD is 
5 • meai^ured for a specific number of tests by the system 
simulator SS and the result is transferred to the 
controller CO, as shown in Fig. 2. According to the 
inventive method the time delays TD are measured. Each 
time delay TD is hard decided, if it is worse or better 
10 than the time limit. Then it is evaluated whether the 
delays are better- than the time -limit in 90% of the 
cases. After sufficient repetitions an overall pass fail 
decision with a wrong decision risk of e.g. 3% is done in a 
minimum possible test time. 

15 

The following realisation is esq^loited: 

The occurrence of the bad delay in all delays, measured, 
is statistically independent, or can easily made 
statistically independent, by inserting sufficient 
20 recovery time after a registration event. Statistically 
independent events are determined by the binomial 
distribution for any error ratio. (Error Ratio ER = 1-SR 
Success Ratio) 

25 For small error ratios the binomial distribution is 
approximated by the Poisson distribution. The use of both 
distributions give meaningful results: The Poisson 
distribution give optimal results in terms of test time 
and statistical significance* for small error ratios, and 

30 the Poisson distribution is well supported in mathematical 
software tools. 

For high error ratios the Poisson distribution give sub- 
optimal results. The results are conservative in the 
35 sense: Test time is longer (worse) than optimal. Wrong 
decision risk is lower (better) than predefined. 

The binomial distribution is optimal in terms of test time 
and statistical significance for any error ratio. However 
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the binomial distribution is not so well supported in 
standard mathematical software tools. Both derivations are 
described in the following. 

5 According to the present invention, the worst possible- 
likelihood distribution PDhigh and/or the best possible 
likelihood distribution PDiow are obtained by the formulas 
given in claim 1 or 2 and 7 or 8, respectively. From these 
likelihood distributions, the average number NE^igh or 

10 NEiow is obtained and compared with NEninitr respectively. 
If NEiiniit is higher than the average number NE^igh or 
smaller than the average number NEiow* the test is stopped 
and it is decided that the device has early passed or 
early failed, respectively. During the test a single step 

15 wrong decision probability for a preliminary BR stage can 
be used, which is smaller than the probability for the 
entire test. 

The Poisson distribution preferably used for the present 
20 invention, is best adapted to a small number of "bad delay 
times". A "bad delay time" is defined as a delay time, 
exceeding the time limit. For exanple a measured time 
delay exceeding the time limit of 8s would be a "bad time 
delay", also referred to as an "error". A measured time 
25 delay TD below the time limit, of for example 8s, would be 
a "good time delay" . 

In the following, a test procedure together with the early 
fail condition and the early pass condition is derived 
30 with mathematical methods. 

The ER test procedure is an iterative process: The number 
ns of delays TD and the number of errors ne are 
accumulated from the beginning of the test to calculate a 
35 preliminary ER (Error Ratio) . Time delays TD up to the 
next error are used together with the past time delays TD 
to calculate the next preliminary ER. Every preliminary ER 
is tested against an early pass or early fail bound. The 
formulas to derive an early pass or early fail condition 



contain a single step wrong decision probability D. This 
is valid only for one specific preliminary ER stage • 
However, it is meaningful to have a wrong decision 
probability P for the entire test (F>D) , The application 
proposes to use a single step wrong decision probability 
D, which is smaller than the probability for the entire 
test and proposes a method to derive D from a given F. 

Due to the nature of the test, namely discrete error 
events, the early stop conditions are declared not valid, 
when a fractional number of bad time delays < 1 are used 
to calculate the early stop limits. The application 
contains proposals, how to conduct the test at this 
undefined areas. The proposals are conservative (not 
risky) . A DUT on the ER-limit does not achieve any early 
stop condition. The application proposes to stop the test 
unconditioned at a specific number K (for example 200) bad" 
time delays. As this proposal contains different 
measurement qualities^ an additional proposal is made to 
overcome this drawback. 

Based on a measurement at a preliminary ER stage pERs, a 
confidence range CR around this measurement is derived. It 
has the property that with high probability the real 
result can be found in this range. 

The confidence range CR is compared with the specified ER 
limit. From the result a diagram is derived containing the 
early fail and the early pass condition. 

With a finite number of delays ns , the final Error Ratio 
ER cannot be dete3nnined exactly. Applying a finite number 
of delays ns, a number of bad time delays ne is measured, 
ne/ns « er is the preliminary Error Ratio. 

In a test at a preliminary ER stage pERs a finite number 
ns of measured time delays TD is applied, and a number of 
bad time delays ne is measured, ne is connected with a 
certain differential probability in the Poisson 
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distribution. The probability and the position in the 
distribution conducting just one test at a preliminary BR 



5 Repeating thxs test infinite times, applying repeatedly 
the same ns, the complete Poisson distribution is 
obtained. The average number (mean value) of bad time 
delays is NE. NB/ns is the real ER at the DUT..The Poisson 
distribution has the variable ne and is characterised by 
10 the parameter NE, the average or mean value Real 
probabilities to find ne between two limits are calculated 
by integrating between such limits. The width of the 
Poisson distribution increases proportional to SQR(ne) 

15 ^''^^ . increases absolutely, but decreases 

relatively. 

In a test at a preliminary ER stage pERs ns time delays TD 
are applied and ne bad time delays are measured. The 
result can be a member of different Poisson distributions 
20 each characterized by another parameter NE. Two of them 
are given as follows: 

The worst possible distribution NEhigh, containing the 
measured ne with the probability D„ is given by the 
25 inverse cumulative operation 

0 

(1) 

30 T' T""^"" 0.002=0.2% PD^i^^ is the wanted 

30 Poisson distribution with the variable ni. ne is the 
measured number of bad time delays. 

The best possible distributions NE^ow . containing the 
measured ne with the probability is given by the 

35 inverse cumulative operation 
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00 

D2 ^\PDUnhNE,^)(ini 



(2) 



In the example D2 is equal and it is D = Di = D2 
0.002=0.2%. 



10 



15 



20 



25 



30 



35 



To illustrate the meaning of the range between NEj^q^ and 
NEhigh refer to Pig. 3. Fig. 3 shows the likelihood 
density PD as a function of the measured number of bad 
time delays ne. In the example, the actual detected number 
of bad time delays ne within ' the measured number ns of 
time delays TD is 10. The likelihood distribution of the 
bad time delays is not known. The worst possible 
likelihood distribution PE>high under all possible 
likelihood distributions as well as the best possible 
likelihood distribution PI>iow under all possible 
likelihood distributions are shown. The worst possible 
likelihood distribution PDhigh is characterized in that 
the integral from 0 to ne = 10 gives a total probability 
of Di « 0.002. The best possible likelihood distribution 
P^low is characterized in that the integral from ne = 10 
to 00 gives a total probability of D2 = 0.002. In the 
preferred embodiment Dx is equal to D2# i.e. Di = D2 = 
0.002 = 0.2%. After having obtained the likelihood 
distribution PD^igh and PDiow from formulas (1) auid (2) , 
the average values or mean values NEhigh for the 
likelihood distribution PDhigh NEiow fo^ the likelihood 

distribution PDiow c;^^ obtained. The range between the 
mean values NEiow and NEhigh is the confidence range CR 
indicated in Fig. 3. 

In the case the measured value ne is a rather untypical 
result (in the example just 0.2% probability) nevertheless 
the real result NE can still be found in this range, 
called confidence range CR. 

The probabilities Di and D2 in (1) and (2) can be 
independent, but preferable they are dependent and equal 
(D = Di - D2) . 
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result of the xnverse cunmlative operations above and are 
shovm xn for^laa (3) and (4) respectively. The inputs are 
the number o£ bad tine delays ne, measured in this test 
and the probabilities D and c = l- d. The Output is ne' 
the parameter describing the average of the Poisson 
dxstribution. ' 

The following exanqple is illustrated in Fig. 3 (D = n 
D2) : X 1^1 _ 



^ 2 (3) 

15 A7"7r - <lchisqiC,2 'ne) 

Example : 



20 



Number of bad time delays: ne=10 
Probability: D=:0.002 C=0.998 



Result : 



NEiow =3.26 
25 NEhigh =22.98 

Interpretation: 

Having measured „e=10 bad time delays in a test with 
prelxminary ER stage pERs, then at a low probability 
30 D.0.002 the average number of bad time delays NE in this 
test is outside the range from 3.26 to 22.98 or with a 
hxgh^ probability 0-0.998 Inside this range from 3.26 to 

35 such as the width of the Poisson distribution, the 
confidence range CR increases proportional to SQR(ne) 
^elltivTir' absolutely. but decrease; 
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If the entire confidence range CR, calculated from a 
single result ne, is found on the good side (NEii^it > 
NEhigh) of the specified NEiimit we can state: With high 
probability C, the final result NE is better than NEnmit- 
Whereby NEii^it is given by 

NEiimit = ERiimit • ns (5) 

and ERiimit is the Error Ratio allowable for the device and 
obtained by an ideal long test with an infinite high 
number ns of time delays TD. 

If the entire confidence range OR, calculated from a 
single result ne, is found on the bad side (NEiimit < 
NEiow) of the specified NEnmit we can state: With high 
probability C, the final result NE is worse than the ER- 
limit - 

With each new time delay TD a new test is considered, 
reusing all former results- With each new test the 
preliminary data for ns, ne and er is updated.. For each 
new test the confidence range CR is calculated and checked 
against NEiimit- 

Once the entire confidence range CR is found on the good 
side of the specified limit (JSTEiimit > NEhigh) » an early 
pass is allowed. Once the entire confidence range CR is 
found on the bad side of the specified limit (NEiin,it < 
NEiow) an early fail is allowed. If the confidence range 
CR is found on both sides of the specified limit (NEio^ < 
NEiimit < NEiiigii) , it is evident neither to pass nor to 
fail the DUT early. 

Fig. 3 illustrates the above conditions. Of course, NEiimit 
is a fixed value not altering during the test, but NEiow 
and NEhigh as well as the confidence range CR are altering 
during the test. For reasons of illustration, however, the 
three possibilities of the possible positions of the 
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confidence range CR with respect to the constant NEii^,, 
are drawn for the same example in Fig. 3. 

The above can be described by the following formulas: 

The current number ns of time delays TD is calculated from 
the preliminary Error Ratio er and the preliminary number 
Of bad time delays ne 

er = ne/ns 

(6) 

The specified ER expressed with number of time delays ns 
and number of bad time delays NE is 
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E^limit = NElimit / ns 
for abbreviation in the formula: 



(7) 



er. 
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norm = ®2r/ERii„it = ne/ NEii^i^. 
(normalised er) 



(8) 



. Early pass stipulates: 



NEhigh < NEllmxt 
25 <9> 

Early fail stipulates: 

NEio„ > NEii^it 
30 Formula for the early pass limit 

norm ~~ 



(10) 



T^'f"' (ernormp.3s (ne, C) ) in Fig. 4 

which shows ernorm as a function of ne. 



Formula for the early fail limit: 



• 
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ne 



er, 



norm 



(12) 



'low 



This is the upper curve (ernormfaii (ne, D) ) in Pig. 4. 

As the early pass limit is not defined for ne = 0 
(normally the case at the very beginning of the test for a 
good DOT) , an artificial bad time delay event with the 
first measured time delay TD can be introduced. When the 
first real bad time delay event occurs/ the artificial bad 
time delay is replaced by this real one. This gives the 
shortest possible measurement time for an ideal good DOT. 
For example ns=50 for ERii^it =0.1 and probability D = Di 
D2 = 0.2%. (6 minutes 20s) 

As the early fail limit uses NEiow < 1 for small ne<k (in 
the exanple below k=5) due to a decision problem at a 
fractional error, the early fail limit at ne=k is extended 
with a vertical line upwards. This ensures that a very bad 
DOT hits the early fail limit in any case after a few 
delays, approx. 10 in the example (1 minute 20s), In other 
words, the test is not stopped as long as ne is smaller 
than k. 

With each new time delay TD a new test is considered, 
reusing all former results. With each new test the 
preliminary data for ns, ne and er and ernorm ^^re updated 
and a ernorm/ne coordinate is entered into the ernorm* 
diagram. This is shown in Pig. 5. Once the trajectory 
crosses the early fail limit (ernorm (ne,D)) or the early 
pass limit (ernorm (ne,C)) the test may be stopped and the 
conclusion of. early fail or early pass may be drawn based 
on this instant. 

Fig. 5 shows the curves for early fail and early pass, 
^^norm is shown as a function of the number of bad time 
delays ne. For the simple example demonstrated in Fig. 5, 
it is ERiimit = 0.2 = 1/5 and the final Error Ratio ER = 
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0.25 (1/4), The test starts with the first time delay TD, 
for which no error (bad time delay) is detected. For the 
second time delay TD, a first error (bad time delay) is 
detected and the preliminary Error Ratio er « ne/ns = 1/2 
and ernorm = er/ERnniit becomes 1/2 : 1/5 « 5/2. ernorm 
after the second time delay TD is marked with a cross a in 
Fig. 5. For the third, fourth and fifth time delay TD, no 
further error (bad time delay) occurs and ernorm 
subsequently becomes 5/3, 5/4 and 5/5, respectively, which 
is marked with the crosses b, c and d in Fig. 5, 
respectively. The sixth time delay TD brings a new error 
(bad time delay) and ne becomes 2. Consequently, er = 
ne/ns becomes 2/6 and ernorm becomes 10/6. This situation 
is marked with cross e in Fig. 5. For the seventh, eighth 
and ninth delay TD, no further error (bad time delay) 
occurs and the situation after the seventh, eighth and 
ninth delay TD is marked with crosses f, g, h in Fig. 5, 
respectively. The tenth time delay TD brings a third error 
(bad time delay) . Consequently, er becomes 3/10 and ernorm 
becomes 15/10. This situation is marked with cross i in 
Fig. 5. As can be seen from Pig. 5, the trajectory is 
between the early fail curve and the early pass curve at 
the beginning of the test, but converges to a line Z, 
which crosses the early fail curve after about forty 
errors. After forty errors, it can thus be decided that 
the tested DUT early fails the test. 

The calculations above give optimal results in terms of 
test-time for small error ratios /high success ratios. If 
this is not the case, the approach with the Poisson 
distribution can be used nevertheless. For any error 
ratio/success ratio the binomial distribution is valid. 
The Poisson distribution is wider than the equivalent 
binomial distribution, hence the confidence range is 
wider, hence the space between the early pass and the 
early fail limit is wider, hence the result is not optimal 
in terms of test-time, but conservative is the following 
sense: the test-time is longer than optimal and the wrong 
decision risk is lower than predefined. 
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To get optimal results also for higher error ratios/lower 
success ratios the binomial distribution must be applied 
as follows: 

The binomial distribution has the following form: 

dbinom (ne , ns / ER) 

with 

ne: number of errors (bad time delays) detected, 
ns, number of time delays TD, measured, 
(ne/ns = preliminary error ratio er) 

ER: the mean value of the* distribution is the error ratio 

The worst possible distribution with respect to a measured 
er«ne/ns is defined by the inverse cumulative operation: 



with 

D: wrong decision risk 
ni : integration variable 

ne: number of errors (bad time delays) currently detected, 
simultaneously integration limit 

ns: number of time delays TD, currently measured 

ERhigh* The parameter to be tuned, to make the integral 

consistent,- This is the wanted value. 

The result has the form: ERhigh = qbinom (C,ne,ns) 

With C=l-D, the complementary wrong decision risk is equal 

to the confidence level. 

The best possible distribution is defined by the inverse 
cumulative operation: 



ne 



D = 




0 



(13) 




ne 



(14) 



with 
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ne: nutnber of errors (bad time delays) currently detected 
simultaneously integration limit 

ns: number of time delays TD, currently n,^» 

, . currently measured, 

simultaneously integration limit 

5 ERiow: The parameter to be tuned, to make the inteqral 
consistent. This is the wanted value. 
The result has the form: ER^^w = qbinom (D,ne,ns) 

Another inverse cumulative inversion, than the one above 

tL "^r""^ "''^ "'^"^""^ mathematical softwar; 

tools. The form is similar: qbinom (D, at least one other 
parameters than above) . "«^xier 
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Early pass stipulates: 
ERhigh < ERii^t 

Early fail stipulates: 
ERlow > ERii„it 



25 is 



in analogy to the Poisson approach, the early fail li^it 



e^norm fail = er/ERio„ 
The early pass limit is 

30 

e^norm pass = er/ERhigh (Igj 

The following consideration is valid for both/ the Poisson 
and the binomial approach: 
35 If no early stop occurs the ER test may be stopped, after 
the following condition is valid- 



ne >= K 



(17) 



16 

and the DUT shall be passed, if ns is sufficiently high. K 
is a maximum number of errors (bad time delays) . For 
example K can be 200. 
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If the trajectory neither crosses the early fail curve nor 
the early pass curve after K (for example 200) errors (bad 
time delays) have occurred, the DUT can be finally passed • 
If the DUT, however, is rather good or rather bad, the 
tests can be stopped much earlier, long before the K = 200 
errors (bad time delays) have occurred. This significantly 
shortens the total test time. 
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In the above embodiment early fail means: a DUT, which 
survived to certain preliminary ER stage, is failed and a 
probability of 0.2 % that it is actually better than the 
BR-limit is accepted. Further early pass means: the DUT, 
which survived to certain preliminary ER stage, is passed 
and a probability of 0.2 % that it is actually worse than 
the ER-limit is accepted. If the test is stopped at 200 
errors (bad time delays) the DUT is passed without any 
early fail or early pass condition arbitrarily. It can 
cross the vertical 200 error line in Fig. 4 at different 
height s- 



25 



30 



Each height is connected with a certain statistical 
interpretation: The probability to have a DUT better 
(worse) than the ER-limit is indicated in Fig. 7. The 
vertical in Fig. 7 shows the position in Fig. 4 at the end 
of the test. The horizontal line in Fig. 7 shows the 
respective probability. Hence such a test has different 
qualities, a better one at the early pass fail limits, and 
a worse and variable one at the unconditioned stop at 200 
errors 



35 The following embodiment overcomes this drawback and I 
additionally . accelerates the test. This is done by ai 
meaningful redefinition of the early pass limit 
maintaining the early fail limit. Early pass means now: aI 
DUT, which survived to certain preliminary ER stage, is I 
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20 



25 



30 



35 
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passed and a probability of 0.2 % that it is actually 

worse than M times the specified ER-lin.it (M > i, Z 

accepted. This is a bad DUT ER-limit. This shifts the 

early pass limit upwards in Pig. 4 as shown in Pig g 

er„orm pass (ne, C) in Pig. 4 becomes er„„_K ^ 
■ in P-irr , "^^normbad pass (ne, C) 

i-ig. 6. ernorm fail (ne, D) remains unchanged. Now it is 

NElimit.M = ERlimit ' M • ns for Poisson 
ERlimit,M - BRii^it • M for Binomial 

and an early pass is allowed, if 

NEiimit • M = NEii^t^M > NEhigfa. (Poisson) ■ 
ERiimlt • M = ERii„it,M >BRhigh (binomial) (ig) 

There are three high level input parameters for the test- 

- Specified error limit e.g. 10% 

- Probability to make a wrong decision in the entire test 
(proposal: F= 3 %) i«-ire cest 

- Definition of a bad DUT (ERji^it • M) 

From this the working parameters are derived- 
D, the wrong decision risk for a single test sten 1« 
derived from P, the wrong decision ri!k for th^ entire 
test. The method to do this is described below. 

With D the early pass and fail limits can be calculated 
according to formula 11, 12, 15, 16. calculated 

The intersection co-ordinatec, r,f ^ -1 

earlv f^-ii i- ^^^^^ates of the early pass and the 

early fail ixmit are the maximum number of errors fh.rf 
txme delay) and the error ratio test limit T. (speciii^d 
error limit<TL<M*specif ied error limit) . 

There are infinite possibilities to overcome the above 
mentioned drawback with different test qualities 

in the example above the open end between the pass fail- 
limxts was originally declared pass, and time was saved by 
-Itxplymg the early pass limit with M (M>1, , shifting it 
upwards such that the early fail and the early pass c!rte 



18 

intersect at 200 errors (200 bad time delays: example from 
above) . Thus only a DOT, bad with high probability, is 
failed (customer risk) . 

The complementary method is: The open end between the 
early pass fail limits is declared fail, and time is saved 
by multiplying the early fail limit with m (0<m<l) , 
shifting it downwards, such that the early fail and the 
early pass curve intersect at 200 errors (200 bad time 
delays: example from above) - Thus only a DUT, good with 
high probability, is passed (manufacturer risk) . 

The conrrpromise method is: The open end between the early 
pass fail limits is partitioned in any ratio: the upper 
part is declared fail and the lower part is declared pass. 
Time is saved by multiplying the early fail limit with m 
(0<m<l) and such shifting it downwards and by multiplying 
the early pass limit with M (M>1) and such shifting it 
upwards. So the early fail and the early pass curve 
intersect at 200 errors (200 bad time delays: example from 
above) • 

With given Di and D2 the early fail curve and the early 
pass curves in Fig. 5 and Fig. 4 or Pig, 6 can be 
calculated before the test is started. During the test 
only ernorm = i^^/NEiimit (for binomial: ernorm = e^r/ERnmit) 
has to be calculated and to be compared with the early 
pass limit and the early fail limit as explained with 
respect to Fig. 5 and Fig. 6. Thus, no intensive 
calculation has to be done during the test. 

Di and D2 above describe the single step wrong decision 
probability for a DOT, which survived without early stop 
to a certain preliminary ER stage. For a real test it is 
desirable to define in advance a wrong decision 
probability F for the entire test. For every step a 
fraction of DOTs leave the statistical totality due to 
single step wrong decision probability D. This accumulates 
to an amount F>D. 
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It is proposed to derive D from F by the following method: 

Based on statistical independence, a large ensemble of 
5 DUTs with ER on the ER-limit (limit-DUT) and with M*ER 
(bad DUT) is simulated and the entire test for the limit - 
DUT ensemble and the bad DUT ensemble is rain by simulation 
against the early pass and early fail bound, with a free 
D-parameter (Di and D2) . The simulation will show, that a 
10 certain fraction F (D<F<1) of the large ensemble falsely 
fails (limit-DUT) or falsely passes (bad DUT) . This 
represents the wrong decision probability F for the entire 
test. D is tuned such that F corresponds to the predefined 
wrong decision probability. 

15 

The initially mentioned wrong decision risk 3% 
corresponds, as a result of the simulation, the single 
step wrong decision risk of 0.2% applied in the formulas 
and figures. 

20 

In retrospect the distributions are not any more exact 
applying this simulation: Once a DUT leaves the 
statistical totality due to early fail or early pass, the 
subsequent distribution is changed. In so far the 

26 initially selected distribution has its intended validity 
only at the beginning of the test. Due to early passes and 
early fails the distribution is truncated more and more 
towards the end of the test. These truncated distributions 
cannot be handled anymore analytically, and so it is 

30 impossible to derive D from P analytically. It is possible 
to derive each subsequent distribution by numerical 
methods. Then it is possible to derive D from F 
numerically. In the above proposed process, just a xinique, 
the initial distribution is applied as approximation 

35 instead of a set of correct distributions. With a set of 
correct distributions it is possible to calculate D from P 
by: 



F = l^(l-i)) 



(19) 



20 



Generally it can be assiimed: 

F>Z)Sl-(l-iO'"" (20) 

5 

This formula can serve as an infimum for D, if the method 
. is based on simulation using the initial distribution. 




1. Method for testing the time delay error ratio ER of a 
device against a msiximal allowable time delay error ratio 
ERiimit with an early pass criterion, whereby the early 
pass criterion is allowed to be wrong only by a small 
probability D^, with the following steps 

- measuring ns time delays (TD) of the device, thereby 
detecting ne bad time delays, which exceed a certain time 
limit, of these ns time delays (TD) , 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 
fixed number of samples of time delays (TD) is PD(ni,NE), 
wherein NE is the average number of bad time delays, 
obtaining PDhigh from 

ne 
0* 

wherein PDhigh is the worst possible likelihood 
distribution containing the measured ne bad time delays 
with the probability Di, 

- obtaining the average number NEhigh of bad time delays 
for the worst possible likelihood distribution PDhigh/ 

- comparing NEhigh with NEii^it = BRiimit ' ns, 

- if NEiiniit is higher than NEhigh stopping the test and 
deciding that the device has early passed the test and 

- if NEiimit is smaller than NEhigh continuing the test 
whereby increasing ns. 

2- Method for testing the time delay error ratio ER of a 
device against a maximal allowable time delay error ratio 
ERiimit with an early pass criterion, whereby the early 
pass criterion is allowed to be wrong only by a small 
probability Pi for the entire test, with the following 
steps 

- measuring ns time delays (TD) of the device, thereby 
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detecting ne bad time delays, which exceed a certain time 
limit, of these ns time delays (TD) 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 
fixed number of samples of time delays (TD) is PD(ni,NE), 
wherein NE is the average number of bad time delays, 
obtaining PDji^igh from 

ne 
0 

wherein PDhigh is the worst possible likelihood 
distribution containing the measured ne bad time delays' 
with a single step wrong decision probability Di for a 
preliminary error ratio ER stage, whereby using a single 
step wrong decision probability Di smaller than the 
probability Fi for the entire test, 

- obtaining the average number of NEhigh of bad time 
delays for the worst possible likelihood distribution 

- comparing NEhigh with NEnmit = ERnn^it " ns, 

- if NEiimit is higher than NEhigh stopping the test and 
deciding that the device has early passed the test and 

- if NEiimit is smaller than NEhigh continuing the test 
whereby increasing ns. 



3. Method according to claim 1, 
characterized in that, 

the single step wrong decision probability Dx is in the 
range of 



4 . Method according to any of claims 1 to 3 , 
characterized in that 
the likelihood distribution PDhigh (ni,NE) is the Poissonl 
distribution. 



5, Method according to any of claims 1 to 3, 
characterized in that 
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the likelihood distribution PDhigh (ni , NE) is the binomial 
distribution. 

€. Method according to any of claims 1 to 5, 
5 characterized in that 

for avoiding an imdefined situation for ne=0 starting the 
test with an artificial bad time delay ne=l, not 
incrementing ne then a first error occurs. 

10 7. Method for testing the time delay error ratio ER of a 
device against a maximal allowable time delay error ratio 
ERiimit with an early fail criterion, whereby the early 
fail criterion is allowed to be wrong only by a small 
probability D2, with the following steps 

15 - measuring ns time delays (TD) of the device, thereby 
detecting ne bad time delays, which exceed a certain time 
limit, of these ns time delays (TD) , 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 

20 fixed number of samples of time delays (TD) is PD(ni,NE) , 
wherein NE is the average number of bad time delays, 
obtaining PDio^ from the 

00 

ne 

25 

wherein PD^ow is the best possible likelihood distribution 
containing the measured ne bad time delays with the 
probability D2, 

- obtaining the average number NBiow bad time delays for 
30 the best possible likelihood distribution PDiow/ 

- comparing NEiow with NEnmit = ERnmit ' ns, 

- if NEiiniit is smaller than NEiow stopping the test and 
deciding that the device has early failed the test and 

- if NEiiiuit is higher than NEiow continuing the test 
35 whereby increasing ns. 

8. Method for testing the time delay error ratio ER of a 
device against a maximal allowable time delay error ratio 



10 
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ERiimit v/ith an early fail criterion, whereby the early 
fail criterion is allowed to be wrong only by a small 
probability P2 for the entire test, with the following 
steps 

- measuring ns time delays (TD) of the device, thereby 
detecting ne bad time delays, which exceed a certain time 
limit, of these ns time delays (TD) , 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 
fixed number of samples of time delays (TD) is PD(ni,NE>, 
wherein NE is the average number of bad time delays, 
obtaining PDiqw from 



CO 

D2 ^\PD,MNEia.)dm 



15 wherein PDiow is the best possible likelihood distribution 
containing the measured ne bad time delays with a single 
step wrong decision probability D2 for a preliminary error 
ratio ER stage, whereby using a single step wrong decision 
probability D2 smaller than the probability F2 for the 

20 entire test, 

- obtaining the average number NEiow bad time delays for 
the best possible likelihood distribution PDiowr 

- comparing NEiow with NEnmit = ERnn^it ' ns, 

- if NEiimit is smaller than NEiow stopping the test and 
.25 deciding that the device has early failed the test and 

- if NEiiniit is higher than NEio^ continuing the test 
whereby increasing ns . 

9. Method according to claitn 8, 
30 characterized In that 

the single step wrong decision probability D2 is in the 
range of 



35 



10. Method according to any of claims 7 to 9, 
characterized in that 
the likelihood distribution PDiow(ni,NE) is the Poisson 
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distribution. 

11. Method according to any of claims 7 to 9, 
characterized in that 

the likelihood distribution PDi^(ni,NE) is the bi«,™ial 
distribution. 

12. Method according to any of claims 7 to li, 
characterized in that 

for avoiding a undefined situation for ne<k, wherein k is 
a snail nunO^r ol bad tine delays, not stopping the test 
as long as ne is smaller than k. 

13. Method according to any of claims 7 to 12, 
15 characterized by 

an additional early pass criterion, whereby the early pass 

probabxlzty D^, with the following additional steps 
- assuming that the likelihood distribution giving the 
distribution Of the number of bad time delays ni in a 
fxxed number of samples of time delays (TD) is PD(ni,NE) 
Wherein is the average nur^er of bad ti.e decays 

obtaining PDhigh from exays. 
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ne 
0 

TZl'l.'^"^"^ likelihood 
distribution containing the measured ne bad time delays 
With the probability Di, 

- obtaining the average number NE^gh of bad time delays 
for the worst possible likelihood distribution PDhioh 

: comparing NEMgh with NBn^it = ^R^t^^ ' na. 

- NEii^it is higher than NEhigh stopping the test and 
deciding that the device has early passed the test and 

- If NEiin^it is smaller , than NEMgh continuing the test 
whereby increasing ns. 

14. Method according to any of claims 7 to 12, 



m 
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characterized by 

an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 
probability Di, with the following additional steps 
- assuming that the likelihood distribution giving the 
distribution of the number of bad time delays ni in a 
fixed number of samples of time delays (TD) is PD(ni,NE), 
wherein NE is the average number of bad time delays, 
obtaining PDhigh from 



wherein .PDhigh is the worst possible likelihood 
distribution containing the measured ne bad time delays 
with the probability Di, 

- obtaining the average number NEhigh of bad time delays 
for the worst possible likelihood distribution PDhigh* 

- comparing NEhigh with NEiimit.M = ERii„,it • M • ns, with 
M > 1, 

- if NEiiinit,M is higher than NEhigh stopping the test and 
deciding that the device has early passed the test and 

- if NEiimit.M is smaller than NEhigh continuing the test, 
whereby increas ing ns . 

15. Method according to claim 13 or 14, 
characterized in that 

the probability Di for the wrong early pass criterion and 
the probability D2 for the wrong early fail criterion are 
equal (Di=D2) . 

16. Method according to any of claims 7 to 12, 
characterized by 

an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 
probability Fi for the entire test, with the following 
additional steps 

- assuming that the likelihood distribution giving the 
distribution of the number ni of bad time delays in a 
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fixed nunODer of samples of time delays (TD) is PD(ni,NE), 

wherein NE is the average number of bad time delays, 
obtaining PDhigh from 

ne 



wherein PDhigh is the worst possible likelihood 
distribution containing the measured ne bad time delays 
with the single step wrong decision probability Di for a 
10 preliminary error ratio ER stage, whereby using a single 
step wrong decision probability Di smaller than the 
probability Fi for the entire test, 

- obtaining the average number of NEhigh bad time delays 
for the worst possible likelihood 4istribution PDhigh^ 

15 - comparing NEhigh with NEii„,it = ERnn^it ' ns, 

- if NEiimit is higher than NEhigh stopping the test and 
deciding that the device has early passed the test and 

- if NEiimit is smaller than NEhigh continuing the test, 
whereby increasing ns. 

20 

17. Method according to any of claims 7 to 12, 
characterized by 

an additional early pass criterion, whereby the early pass 
criterion is allowed to be wrong only by a small 
25 probability Fi for the entire test, with the following 
additional steps 

- assuming that the likelihood distribution giving . the 
distribution of the number ni of bad time delays in a 
fix^d number of samples of time delays (TD) is PD(ni,NE), 

30 wherein NE is the average number of bad time limits, 
obtaining PDhigh from 

0 

35 wherein PDhigh is the worst possible likelihood 
distribution containing the measured ne bad time delays 
with the single step wrong decision probability Di for a 
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preliminary .error ratio ER stage, whereby using a single 
step wrong decision probability Di smaller than the 
probability Fi for the entire test, 

" obtaining the average number NEhigh of bad time delays 
for the worst possible likelihood distribution PDhigh/ 

- comparing NEhigh with NEn^it^M = ERnniit • M • ns, with 
M > 1 

- if NEiin\it,M is higher than NEhigh stopping the test and 
deciding that the device has early passed the test and 

- if NEiiinit,M is smaller than NEhigh continuing the test, 
whereby increasing ns. 



18. Method according to claim 16 or 17, 
characterized in that 
15 the probability Fi for the wrong early pass criterion and 
the probability P2 for the wrong early fail criterion are 
equal (Fi^Fa) . 

19- Method according to any of claims 7 to 18, 
20 characterized in that 

for avoiding a undefined situation for ne=0 starting the 
test with an artificial bad time delay ne=l not 
incrementing ne then a first error occurs. 

25 20. Digital storage medium with control signals 
electronically readable from the digital storage medium, 
which interact with a programmable computer or digital 
signal processor in a manner that all steps of the method] 
according to any of claims 1 to 19 can be performed. 

30 

21 . Computer -program- product with program- code -means | 
stored on a machinereadable data carrier to perform all 
steps of any of claims 1 to 19, when the program is I 
performed on a programmable computer or a digital signal] 
35 processor. 



22 • Computer program with program- code -means to performl 
all steps of any of claims 1 to 19, when the program isj 
performed on a programmable computer or a digital signal! 




23. Computer program with program- code -means to perform 
all steps of any of claims i to 19 when the program is 
o stored on a machinereadable data carrier. 
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Abstract 



A method for testing the time delay error ratio ER of -a 
device against a maximal allowable time delay error ratio 
ERiimit with an early pass and/or early fail criterion, 
whereby the early pass and/or early fail criterion is 
allowed to be wrong only by a small probability D. ns time 
delays TD of the device are measured, thereby ne bad time 
delays of these ns time delays TD are detected. PDhigh 
and/or PDio„ are obtained, whereby PDhigh is the worst 
possible likelihood distribution and PDio„ is the best 
possible likelihood distribution containing the measured 
ne bad time delays with the probability D. The average 
numbers of erroneous bits NEhigh and NBiow for PDhigh and 
PDiov, are obtained. NEhigh and NEiow are compared with 
NEiimit = ERiimit • ns. If NEiimit is higher than NEhigh or 
NElimit is lower than NEiow the test is stopped. 
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